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Abstract 

Frequent unread measurements are shown to enable the extraction of work from changes in the 
system-bath quantum- correlation energy, which constitute a hitherto unexploited work resource. It 
becomes available only when the cycle is shorter than the non-Markovian bath-memory time. 
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In any engine, the working medium (henceforth-the system) exchanges energy with the 
outside world, which consists of baths and external forces. Part of the energy can be exploited 
as useful work, and the rest dissipates as thermal energy (heat). Although this division is not 
always clear-cut, once work and heat are identified jl|, the standard (Kelvin) formulation of 
the second law [2| rules that no work can be performed by the system in a single-bath engine 
over a cycle. 

An exception to this rule is that an observer acting as "Maxwell's demon" can commute 

n 

information acquired by measuring the system into work in a single-bath engine|3|. Here we 
show that frequent measurements of the energy of a quantum system immersed in a single 
bath enable the system to do work in a cycle even if the measurement results are unread (or 
unknown). This finding cannot be attributed to "Maxwell's demon" operation^- 7|, since 
unread quantum measurements provide no information. Nor can it be ascribed to quantum 
coherence in the system, which is the source of work in recently explored quantum heat 
engines (QHEs)js, 9|, since the unread measurements do not induce such coherence lo4l2| . 
Instead, frequent unread measurements are shown to enable the extraction of work from 



changes in the system-bath quantum- correlation energy [10Ml4l|. which constitute a hitherto 
unexploited work resource. It becomes available only when the cycle is shorter than the 
non-Markovian (bath-memory) time. 

Can we reconcile the second law with our findings? We recall that non-selective, brief 
quantum non-demolition (QND) measurements have been theoretically 



experimentally 



11 



13 



14J and 



121 ] demonstrated to cause anomalous (oscillatory) behavior of temperature 



and entropy in a two-level system (TLS) coupled to a thermal bath, as their equilibrium is 
disturbed on non-Markovian time scales. These anomalies, similarly to the present results, 
suggest the need to reformulate the second law in the non-Markovian, quantum regime, 
wherein the thermodynamic paradigm 

of system-^ ^ (Bep ^MU 



fail. Here we pursue this reformulation in the context o 

n 



may 



single-bath engines by revisiting the 



3 



that underlies thermodynamics. 



standard theory of open quantum systems (OQS) 2j, 
This theory reduces the (otherwise unsolvable) system (S) + bath (B) dynamics to the 
effective autonomous evolution of the system, by means of its reduced state p$. The standard 
OQS theory [2| assumes that under weak system-bath coupling the Born approximation 
holds, wherein the influence of the system on the bath is neglected, and the total state is 
the uncorrelated product state p SB « p s <g> p B , currently used in quantum thermodynamics 



Here we show that the autonomous system evolution seemingly contradicts the second 
law, even in the weak-coupling regime: It allows a single-bath engine to extract work in 
a cycle, without any apparent cost. However, this perpetual-motion ("perpetuum mobile") 
paradox jl7| is dispelled when we realize that the standard product-state assumption of 
OQS theory fails to account for the energy cost of a brief QND measurement of S, which 
decorrelates S and B, and thereby triggers their nonequlibrium dynamics. The remarkable 
aspect of this effect is that useful work is extractable from the measurement-induced S-B 
correlation-energy change only if the cycle is completed within a non-Markovian (bath- 
memory) time-scale. 

The model Our model consists of a spin- 1/2 system (S) with energy u a that is coupled 
via the spin-boson Hamiltonian Hsb [16.] to a single thermal bath (B) of oscillators with 
inverse temperature (3 = 1/T governed by Hamiltonian Hb- In addition, it interacts contin- 
uously with a "piston" (P). We assume that the piston is off-resonant and classical, so that 
it parametrically modulates the system Hamiltonian, which then acquires a time-dependent, 
e.g., sinusoidal, form: Hg(t) = u(t)\e)(e\, where u(t) = u a + ASinQt and |e) is the excited 
state of the TLS. More rigorous quantum-mechanical description of the piston and its cou- 



pling to the TLS can be given 



181 ] . without changing the main findings. At t = t m the system 



energy is briefly measured in a QND fashion. At t en d = t m + t cyc i e the piston excitation is 
compared to that at t m , so as to determine whether it did work on S or vice versa. 

Apparent paradox of autonomous evolution The existing treatments of heat engines 
are based on the OQS theory assumption that the system evolution is autonomous (described 
by a Lindblad-type master equation for ps{t)) and suffices for a thermodynamic analysis of 



an engine 



flfl 



15 



19| . Under this standard assumption, the following expression for the 
work over a cycle, W, is expected to hold |l|: 



W = j tr{p s H s }alt = j s(t)u(t)dt. (1) 

Here u(t) is the level-separation (frequency) of the piston-driven TLS, s(t) is the polariza- 
tion (population difference) of its energy-states |e), \g) and the cyclic integral is over a closed 
trajectory in the frequency-polarization plane. The work throughout a cycle is positive for 
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a clockwise trajectory and negative otherwise. The convention is that the work is negative 
if it is performed by the system on the piston 1|. According to Lindblad's H-theoremQ, 
which is the standard OQS expression of the second law, for a single bath engine W > 0, 
i.e., only the piston can do work on the system. Yet, strikingly, our high-precision numerical 
simulations and analytical results show (Fig. 1) that while the system interacts with a bath 
on non-Markovian time scales, it can close a counterclockwise trajectory, i.e., net work can 
be performed in a cycle by the system on the piston (W < 0). 

The time-dependent non-Markovian master equation flO . 
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16| reproduces (analytically) 



the results of the simulations. It yields the evolution of the TLS state, ps{t), that is initially 
a Gibbs state and remains diagonal in the energy basis, with parametrically time-dependent 
energy levels E e (t) — E g {t) = oj(t): 



f) ee (t) = Rg(t)p gg - R e (t)p ee ; Pee{t) = -p B g{t) (2) 

Let us first assume adiabatic and Markovian conditions: i) R g ^(t) > 0; ii) adiabatic 
Gibbs-like stationary state that keeps the detailed thermal balance with temperature /c#T = 
± at all times: R e (t)pH(t) = Rg(t)f%(t), p%(t) = Z~\t) exp{-/3^(t)}, j G (g,e), Z(t) 
being the normalization constant. Under these conditions , we can rigorously prove (Suppl. 
SI) that, since the entropies and energies of ps are equal at the beginning and the end of a 
closed cycle, W = —Q > 0, where Q is the heat generation. This is the standard statement 
of the second law: a single-bath engine cannot yield work. 

By contrast, in the strongly non-Markovian limit of fast modulation Q ^> A > u a the 
sign of W oscillates with Q, for a fixed u a (Suppl. S2), i.e., Eq. (j2j) allows for either positive 
or negative work, as opposed to the Markovian limit (Suppl. SI). At low temperature and 
for weak but fast modulation, | C 1, the work is expressed in terms of the T-dependent 
bath-response Gr(w) as (Suppl. S2) 



W « Ay°° Gr (u;) x ^^^Sznc(^(u + + n)) + Sinc(^(u + -n)))du (3) 

where u + = u+u a . The sign of W alternates with the sine argument, i.e., can be negative. 
Yet what is the source of energy for this work? The brief QND measurement at t — t m does 



Coupling 
spectrum 




FIG. 1. Work extraction by the system in a single-bath engine. Main panel: Work extraction 
from a single-bath (B) engine by a TLS (S) whose polarization (s) is plotted vs. co: results of 
high-precision simulations (see text). The cycles are driven by a piston-induced modulation of the 
unperturbed TLS energy co(t) = u a + ASinQt. The measurement leaves the the system and the 
bath in a product state. The evolution direction is shown by the arrows. The counterclockwise 
sense implies that the system performs work. Two consecutive periods of the modulation are shown. 
While the first period starts with a measurement, the second does not. In the first period (solid 
blue curve) work is extracted from a single-bath engine and the polarization is also cyclic, the curve 
is closed and the enclosed area is the work W < according to Eq. ([1]). In the second period 
(dashed brown curve) work is extracted (W < 0) as well, but the polarization is not cyclic, i.e., the 
curve is not closed, even though the modulation is periodic and the initial polarization (marked by 
a red point) is the same as in the first period. The curves are different in each period, since the 
initial supersystem (S+B) states are different, so that correlations with the bath are different (see 
text). The parameters for the solid and thin curves are H = ks = 1, 0J a = 1, A = 1/4, Q = 5/2. 
Inset: The S-B coupling spectrum, chosen to be a Lorentzian centered at ujq of width t~ l (inverse 
correlation or memory time of the bath response). The system-bath parameters are (in same units): 
uq — L} a = 3/7 where u a is the TLS resonance (transition) frequency unperturbed by the piston, 
t c = 10 and the inverse bath temperature is /3 = 3.74. 



not change the state of the system, p$, nor that of the bath, p#. Under the tenets of the 
standard OQS theory p$B ~ Ps <H> Pb, which implies that the measurement should carry no 
cost and have no bearing on W. Hence, the results of Eqs. ([I])-©, that work is done by S 
on P in a cycle appear to allow a perpetual-motion (perpetuum-mobile) engine 17 1. 

Measurement cost To resolve the paradox, we must examine whether the assump- 
tion that underlies Lindblad's H-theorem, i.e., that S is autonomous, does apply on non- 
Markovian time scales. The indication that this standard assumption may fail in the non- 
Markovian domain is the drastic difference between the (precisely simulated) solid-line and 
dashed-curve evolution during the first and second periods of the modulation, respectively 
in Fig. 1. Namely, starting with the same p$, i.e., at the same point in the u — s plane, at 
the outset of the first and second modulation periods, does not entail the same subsequent 
evolution of ps{t)- This implies that contrary to the standard assumption l|, |2| it is wrong 
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to assume that the system dynamics is always autonomous: in the non-Markovian domain, 
the correlations of the system with the bath are crucial! 

Accordingly, the second law is upheld or reinstated (in the sense that perpetual mo- 
tion becomes forbidden) only when we account for the energy and entropy cost of chang- 
ing the "supersystem" state p$B from its initial correlated form at equilibrium (p e g B = 
Zg 1 e~P( Hs+HB+HsB ^ > 7^ ps ® Pb) to its post-measurement form PsB(t m ), (which is nearly 
a product state, as shown in Suppl. S3). This measurement cost comes about from chang- 
ing the mean system-bath correlation energy from a negative equilibrium value 1(3, 
(HsB{t = t^ri))eqi to zero after the measurement, {Hsb{^ = tm)) = 0' where t — i~ and 
t = t+ are the instants just before and just after the measurement, respectively. The energy 
injected to the "supersystem" by the measurement is AE = — {HsB{t^ n )) eq , which is a pos- 
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11] . Eq. d2J) cannot account for this cost, which requires the analysis of 



itive quantity 
Psb- 

This cost becomes evident in a description of the evolution in terms of the total Hamil- 
tonian H tot and the corresponding state p tot that encompass the degrees of freedom of the 
detector and the supersystem, yielding the work 

W tot = I tr{p tot H tot }dt. (4) 



It is important that a "true" cycle of p tot in Eq. (j3J) may be very different from the "pseudo- 
cycle" in Eq. ([T|) which only ensures that ps return to its initial value after a modulation 
period (Fig. 1) The non-negativity of the work W to t > 0, under a cyclic unitary evolution of 
the Hamiltonian (H to t), encompassing the supersystem and the detector and starting from 
a brief disturbance of the equilibrium can be proven (Suppl. S4) completely generally . For 
a cycle of duration r 



W tot (r) = Tr (U(r)p tot (0)U^r)H tot (0) - p tot (0) H tot (0)) . (5) 

where the first term is the final mean energy and the second is the initial one. Because the 
total dynamics is unitary, the entropy of p tot is fixed. This implies that the final mean energy 
(first term) must be greater than or equal to the initial one (second term), as the thermal- 

6 



equilibrium initial state minimizes the mean energy at fixed entropy. Hence Wt t{i~) > 0. , 
i.e., (modulation) Eq. may still allow the system to do net work on the piston during the 
cycle (W<0), but it compensates for this work by the energy cost AE of the non-selective 
QND measurement, so that rigorously, W to t — W + AE > during the cycle, in keeping 
with the second law. As we show numerically (Fig. 2) part of the energy stored in (HsB(t)) 
(after the measurement) is converted into work. The strong dependence of the sign of W on 
the cycle duration t cyc \ e proves that work retrieval from (Hsb) is limited to non-Markovian 
time scales (Fig. 2a-Inset): t cyc i e should be much shorter than t c , the bath memory time, 
to ensure work performance by the system. 

The maximal work that can be done by the system on the piston via an unread (non- 



selective) measurement, as described above, is given by 20| iW n on-sei)Max — —AE + TAy, 
AE being the energy invested by the detector in the measurement, T the bath temperature 
and AS^ the entropy change of pss caused by the measurement [2 1| . The ratio of this work 
to AE is a measure of the maximal efficiency or reversibility, i.e., the ability of the system to 
recover the invested energy as useful work from the correlations with the bath at equilibrium 

sel)Max 1 

€Max ~ AE -{{Hsb)U- 1 (6) 

where AE = -((H SB )) eq > and Ay(p SB ) > 0. 

No need for resetting the detector It might be expected that resetting (purifying) 
the detector is necessary if we wish to reuse it and that would add to the thermodynamic 
cost 4 , 0] of multiple cycles, i.e., reduce the extractable work after one cycle. However, the 
detector (D) can be repeatedly used without resetting, no matter how mixed its state, since 
its information is unread. Nevertheless, it performs a genuine measuring in that it becomes 
correlated with S. To avoid the adverse effects of such correlations, we add after the fast 
modulation a relaxation period during which the correlations between S and D decay owing 
to the single-bath. Thus, after the fast modulation we wait long enough, so that the S-B 
and D density matrices decorrelate via thermal relaxation and revert to a product state: 
Ps+b+d Psb ® Pd- After this relaxation period (Fig. 2b) the detector can be reused 
in the next cycle and have the same effect as in the first, i.e., again erase the system-bath 
correlations. Hence, there is no need to reset the detector for further use. 

Discussion The proposed work anomalies cannot be explained by viewing the unread 




FIG. 2. Simulations of work extraction in a single-bath engine. Main panel: Simulation of the first- 
cycle evolution of the energy of the system (Hg) (solid thick blue line), the bath (Hp) (solid thin 
purple line), the classical piston ((Hp)) (dashed thin green line), and the system-bath correlations 
(Hsb) (dashed thick brown line), same parameters as in Fig. 1. The cycle starts with a measurement 
at time uj a t = 1 and ends at uj a t = 3.51. The measurement invests AE = — (Hsp(t = t m )) in the 
system. (Hp) has gained energy during the cycle, but not at the expense of (H$) which returns 
to its initial value. Since (Hp) has also gained energy, the source of work is (Hsb), the system- 
bath (correlation-dependent) interaction. The simulations imply that Wtot = W + AE > 0, in 
accordance with Eq. (HJ), although W = (Hp(t m )) — (Hp(t en( i)) < 0. (b) Decay of the off-diagonal 
system-detector (S-D) elements (correlations) (i\ptot\j) under Htot (Eq. (2)) where \i) = \e, l,n) 
and \j) = \g, 0,n±l), the entries denoting the system, detector and bath quantum numbers, 
respectively. The detector frequency is 10/7. The decay time of the correlations is that of the 
oscillations envelope, here ~ 4 modulation periods (4t moc j). After this time the detector can be 
reused for the next cycle. Inset: (a): work done by the piston on the system W (normalized 
by (W non _ se [)Max, the maximal work obtainable via a non-selective measurement (Eq.([H])) as a 
function of the cycle duration t cyc i e . It is seen that W < (work done by the system) requires 
tcycle t c being the bath memory time, (b): NV-center spin (S) in diamond coupled to a nuclear 
spin-bath(B) is driven by a cantilever that can act as a piston (P). The detector is a periodic spin 
readout that acts on S. 



detector as a fictitious additional "bath", since the detector continuously equilibrates with 
the single bath. The second law is upheld only if we account for the change of correlations 
between the system and the single bath, caused by the brief measurement (Fig. 2, Main 
Panel): This change, the crux of the present results, allows a single-bath engine to do 
work that is unaccounted for by Lindblad's H-theoremQ and prompts a reformulation of 
the second law for open quantum systems that undergo cycles in the non-Markovian time 

8 



domain. 

Unlike cases 



master equation 



19] where the master equation is simply not valid, here the non-Markovian 



10 



12 



22] adequately describes the system. What fails is the standard 



premise underlying Lindblad's H-theorem that the system dynamics is autonomous. This 
failure may have far-reaching implications, since the H-theorem is routinely used as a test 
of the validity or physicality of open- Instead, in the non-Markovian 

time domain, we have shown that the analysis must be extended to the total (combined) 
state of the detector, the system and the bath. Only such an analysis can rid us of the 
perpetual-motion paradox and yet allow for work by the system on the piston, as opposed 
to Markovian analysis 2l|. This opens the door to a revision of traditional thermodynamics 



that would extend it beyond the system-bath partition (separability) paradigm, so as to 
allow for system-bath correlations. 

On the practical side, the present engine model, in which the system is always coupled 
to a single bath and yet may perform useful work, is potentially important for nanoscale 
systems totally embedded in a single bath, so that conventional thermodynamic cycles may 
be impossible to implement. Nanomechanics 



23l [ and spintronics|24l[ provide a variety of 



testbeds for the predicted measurement-based QHE: In particular, mechanical work is ob- 
tainable in setups where the "piston" is a nanomechanical cantilever that is magnetically 
coupled to a nitrogen-vacancy (NV) electron spin (qubit) in diamond 25| that interacts 
with a nuclear spin bath (Fig. 2-Inset b). The cycles in Fig. 1,2 are realizable in this setup 



by QND measurements 



261 ] (readout) of the qubit. The long memory time of the spin bath, 



t c ^> fisec and the ability to monitor single spins are appealing features. It is also interesting 
to study cases where the resource that can power such an engine may be "gratuitious", i.e., 
natural processes that decorrelate the system from the bath at controlled intervals less than 
t c . The performance of such an engine may be optimized by selecting the measurement rate 



22 



27 



28] . Further investigation 



that appropriately steers the non-Markovian dynamics 
may include brief disturbances other than measurements, e.g., phase flips of a TLS in a spin 
bath|28|. 



To conclude, the present findings lead us to reformulate the second law for quantum 
scenarios wherein the thermodynamic paradigm of system-bath separability fails, as follows: 
A quantum system can perform work in a closed cycle in a single-bath engine, through 
changes in the system-bath correlations within the memory time of the bath. Most saliently, 



work can be even extracted in the presence of a zero-temperature bath via a measurement. 
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Si No work can be extracted from a single Markovian bath engine in a closed 
cycle 



To prove our result consider the entropy production rate in the Markov approximation 



a = - ^pjjQnpjj-hip 



~(RgPgg ~ RePee) In ^Tg + {RgPgg ~ RePee) In ^f§ — 
Pee Pgg 

—R g Pg q g (xlny — xlnx + x — y) — 

R e pH(ylnx — ylny + y — x) > (SI) 

where x = ^if and y = £§f . Notice, that R g p e g q g (x — y) + R e p e e l(y — x) = due to adi- 
abaticity. The inequality in flSl j) is obtained from the relation a In a — a In b + b — a > 
(for a, b > 0) and assumption A). It implies the following inequality for the entropy S(t) = 



11 



S=~J2 PjJ ln Pjj - ~ Yl Pjj ln P?i = 

j j 

Q = Y,Pjj E j- ( S2 ) 



where we used the fact that Y2j Pjj m ^(^) = m ^j Pjj = ^- 



Since in a closed cycle the entropies and internal energies in the initial and final states 
of the system are equal, W = —Q > (which is the second law of thermodynamics) . This 
means that we cannot extract work from a single Markovian bath engine. 

S2 Analytical work calculation in the non-Markovian regime We wish to evaluate 
the work performed by a qubit in contact with a bath at temperature T after a non-selective 
measurement of its energy, over a period (cycle) of its energy modulation of the form u(t) = 
bj a + ASinQt. This requires the evaluation of l| 
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Ce = - / S (^- ( S3 ) 
JO 

We shall use the results of the weak-coupling non-Markovian master equation 
whereby 

s(t) = e~ J{t \ J AR(t')e J{t,) dt' + s(0)). (S4) 

Here J — J g + J e , J g ( e ) = f Q R g ^(t')dt' and AR = ^(R g (t) — R e (t)), depend on the 
non-Markovian bath-induced transition rates R e (t) (|e) h> \g)) and R g (t) (\g) h-> |e)). Both 
J and R are proportional to the square of the system-bath coupling strength, rj. Since the 
coupling is assumed weak, s(t) can be expanded as s(t) ~ (1 — J(£))s(0) + AJ(t). The first 
term does not depend on the time and does not contribute to the work. Plugging the rest 
in the work definition and rearranging 



2tt 



Jo J\tt) 
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where 



J g{e) (t)ttACosQtdt 



o 



QA / duG T (u))x 



nm ' 

Sira^w* + (n + + f (n - m)) - 5m(f (n - m)) 



u ± + (n + i)n 

)n + f (n - m) 
w± + (n - 



Sm(^f (c^ + (n - + f (n - m)) - Sm(f (n - m)) , 



where a; 1 * 1 = a; ± u; a This expression allows for either positive or negative work extraction, 
as opposed to the Markovian limit. 
S3 The measurement process 

The time-dependent system-detector coupling has the form 



H S n(t) = h(t) |e> (e| (|0> (0| + |1) (1| - |0> (1| - - |1> (0|) (S7) 

where 

" (t) - £ H (^r) - 1 

is a smooth temporal profile of the system coupling to the detector qubits during the 
measurement at time t m which lasts over time r m . 

This form of the single- measurement Hamiltonian Hsd is chosen so that 




e- i K m * Sa * S& = Uc (S9) 

where Uq denotes to the CNOT operation (with the detector qubit, as the target qubit). 
If the measurement duration r m is much shorter than the other time scales, then only Hsd 
is non- negligible during this time, and the entire action is well approximated by the CNOT 
operator Uc- This becomes exact in the impulsive limit r m — > 0. 

The measurement outcomes are averaged over (for nonselective measurements), by tracing 
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out the detector degrees of freedom. As long as the detector state is of the form 



p D = 1/2/ + aa z (S10) 
where a is real, the measurement will not affect ps, which is diagonal in the energy basis: 

Ps 1 — ► Tr D (u c p s ® Pd^c) = 

\e)(e\p s \e)(e\ + \g)(g\p s \g)(g\ (Sll) 

i.e., the diagonal elements of ps are unchanged, and the off-diagonal elements are erased. 
Since the system is entangled with the bath, the effect of the measurement on p$B is: 



Psb 1 — > Tr D (UcPsb <8> PdU ] c 
|e) (e| psb |e) (e| + |#) (#| p 5B \g) (g\ = 



Pee\e)(e\ + pt\g)(g\ (S12) 



where p^, and are bath states correlated to |e) and |p) respectively. Thus, the post 
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llil 



measurement psb is block-diagonal in the energy states of the system. It can be shown 
to be close to a product state of ps and pB- 

S4 Non-negativity of work in a cycle The total Hamiltonian is H tot = H + H D + 
Hbd + Hsdi Hsd is the system-detector coupling term, the bath-detector coupling Hbd 
allows a fast decorrelation between the system and detector (see below) , and Hq describes the 
"supersystem", system+bath. Using the fact that the total Hamiltonian is cyclic, H to t{T) = 
Htot{0), the total work in a cycle can be written as 



W tot (r)= [ Tr(U(t) Ptot (0)U\t))H tot (t))dt = 
Jo 

Tr (ptot(r)H tot (r) - p tot (0)H tot (0)) - 

f Tr(p tot (t)H tot (t))dt (S13) 
J o 
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Upon inserting the expression for ptot{t) and calculating the trace we find that the second 
term on the RHS is zero. The first term thus represents the energy change of the supersystem. 
Since initially the supersystem and the detector were at thermal equilibrium, any energy 
change should be positive. The second term on the RHS being zero, we then obtain Eq. (jSJ). 
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